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(54) Method and apparatus for the recording and reproduction of video and^or audio ^gnals 



(57) A method for the recording and r^roduction of 
video and/br audio signals is proposed in which an addi- 
tional infomation item, e.g. a title information item, is 
additionally recorded, which Information item serves for 
&ut>sequent insertion into a video picture during repro- 
duction. Accor««ng to the invention, the additional infor- 
mation data are converted, thereby producing an 
executable sub-picture unit (SPU). which is recorded in 
a corre^nding subi)icture data pack (SP^PCK) in 
addition to the data packs for the video/audio signal 
(V.PCK, A_PCK). Thus, it is posstole to record the 
additional infomiation data separately without difficulty, 
without necessitating a change to the recording format 
to the effect that special data packs for the additional 
information items are included in the planning. 

The invention also relates to a corresponding 
recording and reproduction apparatus. 
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to have inserted, since even the existing DVD players 
already provide the option of selecting subtitles in differ- 
ent languages. 

[0007] It is likewise advantageous that the outlay on 
circuitry at least for the r^roduction of the additional 
infomiation items is very low. since for this purpose use 
is made of the same sub-picture decocfing unit which is 
also used othenivtee during the decoding of the sut>-pic- 
ture unit for subtitles. An additional circuit can therefore 
be omitted in this case 

[0008] Advantageous developments and improve- 
ments of the method specified in Claim 1 are poss&Ae 
by virtue of the measures evinced in the further Claims 
2-10. Claim 2 characterizes the structure of the sub- 
picture unit more precisely In particular, the fact that the 
sub^)icture unit conprises a compressed bit map for 
the additional information items is defined in this claim. 
This property is advantageous because a considerable 
amount of memory space can be saved as a result The 
memory space obtained in this way can be used for 
concomitantiy storing a plurafity of different additional 
information items which can be inserted alternatively 
Furthermore, the fact that a sut>-ptcture unit comprises 
a table with control commands for the insertion repre- 
senting the additional information item is defined in 
aaim 2. Commands of this type are already known from 
the DVD Standard. They allow diverse possibilities for 
configuring the insertions. Thus, graphical symbols can 
also be inserted, and it is possible to use different types 
of highlighting for charact&^ etc. Therefore, the addi- 
tional information item is not just restricted purely to text 
information, it can also relate to specific symbols and 
grapftics. 

[0009] By way of example, in accordance with Qaim 
3. run length coding can advantageously be used fa the 
compression of the bit map. IHs is simple to implement 
(001 0] According to Claim 4, the additional information 
item can be input by an operator or else be machine- 
generated, such as e.g. in the case of insertion of the 
playing time or of the time of day and of the date. 
[001 1 ] A very advantageous measure is specified in 
Claim 6, which prescribes the provsion of a table with 
characters that are already run length-coded, from 
which table the characters required for the additional 
information items are selected and are "combined to 
form the resultant bit map of the sub^Dicture unit This 
considerably simplifies tiie routine coding process. The 
conaete specifications which are made in the table for 
each character are specified in Claim 7. A number of cfif- 
ferent additional information items which can be 
recorded are specified in Claim 9. 
[001 2] A programming option which enables the user 
to prescribe the order in which the additional information 
items that he desires are to be successively inserted 
can also advantageously be provided in the method 
according to the invention. 

[0013] A corresponcfing recording and reproduction 
apparatus for the recording and reproduction of video 



and/or audio signals in which an additional information 
item can additionally be recorded is specified in Claim 
11. 

5 Drawings 

[0014] Exen^ary en*odiments of the invention are 
illustrated in tiie drawings and are explained in more 
detaa in the description below. In the drawings: 
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Rg. 1 



15 Rg. 2 
Rg.3 



20 



Rg.4 



Rg.5 



shows the division of the recorded 
data stream of a DVD into video data 
packs, audio data packs and sub-pic- 
ture data packs; 

shows the structure of a sub-picture 
data pack; 

shows the staicture of a sut>-picture 
unit; 

shows the division of a sut>-picture 
unit into a number of sub-picture data 



shows a block cfiagram concerning tiie 
recording part of the recording and 
reproduction apparatus; 
25 Rg. 6 shows a block diagram of the repro- 

duction part of the recording and 
r^}roduction apparatus; 
Rg. 7 shows a flow diagram for a program 

for generating the compressed bit 
map of a sub-picture unit; 
Rg. 8 shows a flow diagram for the conver- 

sion of the additional information item 
into a sub-picture unit; 
Rg. 9 shows a rough fkw diagram for a pro- 

gram for generating tiie sub-picture 
data packs from the additional infor- 
mation items; 

Rg. 10 shows a program listing for an exam- 

ple of a program for real-time sub-pic- 
^ ture data pack generation; 

Rg. 11 shows three exantples of function 

calls relating to the program in Rg. 1 0; 
Rg. 12 shows a fourth, more detailed exam- 

ple of a function call, and 
45 Rgs. 13a-13i show eight examples of applications 
for additional information insertions. 



Exemplary embodiments of the invention 

so [0015] Rgure 1 illustrates the structure of a video 
ot^ect set (VOBS) in accordance with the DVD Standard 
mentioned in the introduction. A video object set is part 
of tiie logical data stmcture of a DVD video cfisc which is 
described in very precise detail in the DVD Standard. 
55 Further data units are also stored on a DVD disc, but 
tfiey will not be discussed in more detail since tiiey do 
not comprise the video and audio data and the data for 
a sub-picture unit which are important for the invention 
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correct physical order and can be used directly for 
recording on the DVD cfisc 51. The reference numeral 
41 designates the data buffer for the audio data. The 
data located therein are processed by the audio coding 
circuit 44. which may be, for example, either an MPEG 5 
aixito encoding ctrcuii or a DOLBY ACS audio encoding 
circuit The data thus generated are made available in 
turn to the data formatting unit 49. 
[0020] The reference numeral 47 designates a key- 
board unit The latter is connected to a microcontroller jo 

46. The user can carry out inputs via the k^board unit ' 

47. In particular, he can input e.g. a desired title which rs 
to be concomitantly recorded. Of course, any other 
desired inputs are equally well possible by this means. 

In the microcontroller 46, the data that have been input is 
are likewise ordered logically again and then forwarded 
to a buffer store 42. The data located therein are revised 
by a sub-ptcture cocfing unit 45. A sub-picture unit for 
the data that have been input is generated in the sui>- 
picture coding unit 45. The said sub-picture unit is then 20 
fon^arded to the data formatting unit 49. The formation 
of the data packs for the video data packs, audio data 
packs and subisicture data packs can preferably be 
performed in the data formatting unit 49. 
[0021] A real-time dock 48 is additionally connected 25 
to the miaocontroll^ 46. Tlme-ofKlay data and also 
date details can be communicated by the said real-time 
clock. These data and details are then also converted 
by the microcontroller 46 and can be used for special 
insertions (sub-picture insalions). It has not been men- 30 
tioned heretofore that the recorded data are protected 
by multiple error protection. This ta^ can also be 
undertaken by the formatting unit 50. 
[0022] As an alternative, the sub-picture encoding unit 
45 may also be integrated in the microcontroller 46 if the 3S 
latter is correspondingly powerful enough. 
[0023] The tAock diagram of Figure 6 is explained 
below; Rgure 6 illustrates the essential conponents 
used during reproduction of the recorded data. The ref- 
erence numeral 58 designates a serial data input ^ 
where a bit stream is present which contains both video 
data and audio data and the data for the sub-pictures. 
The data are supplied by an optical storage disc DVD 
51. The incoming data are then initially subjected to 
error detection and correction in a correction unit 60. 45 
The data subsequently pass into a s^rator circuit 61 , 
in which the video, audio and sub-picture data, which 
are still mixed together, are separated and respectively 
transferred accordingly either to a video decoding unit 

62. a sub-picture decoding unit 63 or to an audio decod- so 
ing unit 68. The decoded video and sub-picture data are 
made available to a multiplexing unit 64. The multiplex- 
ing unit 64 is controlled by the sub-picture decoding unit 

63. At the output of tiie multiplexing unit 64. the data for 
the individual pixels of the video picture are succes- ss 
sively input into a TV signal decoding device 65. The 
standard-conforming luminance and chrominance sig- 
nals (Y. C) are output in digital fonm at Uie outputs of the 



TV signal encocfing device (PAL SECAM, NTSO). 
These agnals are sui)sequentty converted into analog 
signals in the D/A conversion unit 66 and forwarded to 
corresponding outputs 70. 71. The associated audio 
signal is already generated in a standard-conforming 
manner in the decoding device 68 and converted into an 
analog audio signal (only a nrK>no signal is illustrated in 
this case) in the D/A conversion unit 69. This audio sig- 
nal is made availat^le at the output 73. 
[0024] In another embodiment the audio signal may 
also be output in digital fam. This signal must be proc- 
essed further in an external decoder in that casa 
[0025] On the other hand, the embocfiment may also 
be such that the analog luminance and chrominance 
signals and the audio signal are modulated onto differ- 
ent carriers in a modulation unit 67 and output as a cor- 
responding V signal via just (me output 72, 
[0026] The reference numeral 59 designates an addi- 
tional input for the keyboard unit 47. The input can also 
be embodied as an infrared input if the keyboard is inte- 
grated on a remote control. The microcontroller 46 
serves to control the units 60. 61 , 62. 63, 68. After a cor- 
responding selection command has been input the 
nrv'crocontrolter 46 sets e.g. the suivpicture decoding 
unit 63 in such a way that it decodes only that sub-pic- 
ture unit in accordance with the input All other sub-pic- 
ture units that may be present are then ignored. The 
sub-pk:ture decoding unit 63 then inputs the decoded 
data into the bit sfream for the entire video picture at the 
preprogrammed locations. For this purpose, the sub- 
picture decoding unit 63 drives the multiplexing unit 64 
with correct timing in accordance with the horizontal and 
vertical sync pulses, input into the said unit by the TV 
signal encoding device 65, and the pixel dock signal. 
Further details concerning the structure and the method 
of operation of aich a sub-picture decoding unit 63 are 
contained in EP-A-0 725 541. In this regard, therefore, 
reference is expressly made to this document as well. 
[0027] Since the essential difficulty of the invention 
resides in generating ttie sub-picture unit under real- 
time conditions for a titie insertion, an example of a pro- 
gram for sub-picture data pack g&ieration is explained 
below with reference to the flow diagrams of Rgures 7 - 
9. The compressed bit map which is used for the sub- 
picture unit is generated from a prescribed ASCII text by 
means of the program according to Rgure 7. 
[0028] A completely executable sut)-picture unit is 
generated from the compressed bit map generated pre- 
viously by means of the program in accordance with 
Rgure 8. Then, finally, a complete sub-picture data pack 
is generated with the aid of the sub-picture unit gener- 
ated by means of the program in accordance with Rg- 
ure 9. This sub-picture data pack can then be inserted 
directly into the sector stream of a video object unit 
VOBU. The precise way in which this is to be done is 
already disclosed by the DVD Standard and, therefore, 
need not be explained in any further detail here. 
[0029] Rrst of all the function for generating the com- 
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/* generates byte alignment for the compressed bitmap of a SP line: 
#define putAlign( ) if( Itmppos); else putHBit( (Uint32) 0, 8-tmppos) 

puts the <n> most significant bits of the 32 bit value <b> 
* into buffer <brtmap>: */ 
static void putBltC Uint32 b, Int32n){ 

*/ significant bits in <b> are on the left side of Uint32 word V 

while( "n>=0) { 
tmppos++; 
tmbbuf a= 1; 

if( b&(unsigned Iong)0x80000000 ) tmpbuf++; 
b«=l; 

if( tmppos==8) { 
*bitmap++ = tmpbuf; 
tmppos = 0; 
tmplen++; 



) 
} 

)/* putBitO*/ 

/* puts the <n> most significant bits of the first 8 bits of 

* value <b> Into buffer <bitmap>; */ 
static void putHBit( Uint32 b, Int32 n ) { 

putBit( bti24, /* significant bits to left long word limit */ 
n); 

}/* putHBitO V 

/* puts the <n> least significant bits of the 32 bit value <b> 

* into buffer <bitmap>: */ 

static void putLBIt( Uint32 b. Int32n) { 

putBit( ba(32-n), /* significant bits to left long word limit */ 



n); 

)/*putLBit() V 
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else /* it's a special char */ 

switch( *text ) { 
case':': character = 1 0; break; 

default: character =3 1 1 ; break; /* use space as default */ 

/* get leading background pixel: */ 

n = lastNBackgroundPel + characterSetl character ] [ row J .nBeglnningPel; 

/* when there are pattern pixel for this row then encode those; */ 
if( characterSetl character ] ( row 1 .nNibbel ) { 

/* encode leading background pixel (if any): */ 
while(n) { /* generate run-length code */ 

if(n<16) 

if(n<4) 

putLBit( n, 2 ) ; /* put the 2 LSB of n onto bitmap V 
else 

putLBit(n, 6); 

else 

if(n<64,) 

putLBit(n, 10); 
elself(n<256) 

putLBit(a 14); 
else 

putLBit(255. 14); 
putHBit( 0, 2 ); 
if(n>=256)n-=255; 
else n =iO; 

} . . 

/* insert preen coded character run-lerigth code: */ 
for( n=0; n<characterSet( character | ( row 1 .nNibbel; n++ ) { 
if(n&l1) /♦odd*/ 

putLBit{ characterSetl character II row ].runLengthcode(n» 1 ], 4 ); 
else/* even */ 

putHBit( characterSetl charaaer 1[ row ).runLengthcode[n» 1 ], 4 ); 

/* prepare encoding of trailing background pixel (if any): */ 
lastNBackgroundPel = characterSet( character 1 ( row ] .nRemainingPel; 

} else { /* there are no pattern pixel to encode */ . 

/* prepare encoding of background pixel (if any): */ 

^ lastNBackgroundPel = n + characterSetl character ] [ row ) nRiemainingPel 

/* Insert space between 2 charaaers: */ 
lastNBackgroundPel += SPACE_BETWEEN_2_CHARACTERS; 
text++; /* next charaaer */ 
)/* while*/ 

/* encode the remaining background pels of the current SP row: */ 
n = lastNBackgroundPer+ offsetRight - SPACE.BETWEEN_2.CHARACTERS 
if(n){ 
if( n<16) 
if( n<4) 

putLBit( n, 2 ); /* put the 2 LSB of n onto bitmap */ 
else 
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putLBit( n. 6 ); 
else 

if(n<64) 

putLBtt(n. to); 
ekeif(n<256) 

putLBit( n, 14 ) ; 
else 

putLBit(0. 14); 
putHBiK O. 2 ); , 

/* add nibbel stuffing in order to get the SP line byte aligned: V 
putAlign{ ) ; 
} /* for row */ 

/• lower background pixel offset of the SP: */ 

for( row={offsetUp+N_ROWS+topField)&1; row<offsetDown; row 2 ) { 

*bitmap++ =0; 
^.*bitmap++ =0; 

/* return the byte length of the just encoded compressed data V 
return (Utnt32) (bitmap - startOrBitmap); 

)/* makeCompressedSitmapO V 

y ************* 
* 

* Extern Function: makeSPU( ) 
♦ 

. * Encodes characters from a text string to complete SPU 

* Input: pointer to an already allocated buffer for the complete SPU 

* and a text string whicn shall be encoded as SP 

* Output: the encoded SPU 

* Return value: length of the whole SPU 

extern Uint32 makeSPU ( ) 

UintS ntsc. - /* 0: 625/50; 1: 525/60 */ 

UintS *spuBuff er, /* OUT: already allocated buf fer for the SPU */ 

char ♦text, /* this text shall be encoded as SP */ 

Ulnt32 durationlnFrames. /* after this no. of frames 

* the SP shall disappear V 
Uint32 starty /* vertical start position of the SP */ 

Uint32 

spWide, /* horizontal size of SP (\n pel) */ 
spHeight, /* vertical size of SP (in pel) */ 
lenTop, /* byte length of the top field compressed bitmap */. 
lenBottom, /* byte length of the bottom field compressed bitmap */ 
startx; /* start column of the SP on saeen V 
Uint32 

offset /* byte offset relative to the start of the SPU V 

starty &= -1 ; /* starty MUST be even */ 

/* generate run-length code for top field: */ 
lenTop = makeCompressedBitmap( spUBuffer+4 

0, 

text. 
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8,8,3. 3, 

&spWide, &spHeight); 

/* generate run-length code for bottom field: */ 
lenBottom = makeCompressedBitmap ( spuBuffer+4+lenTop, 

text, 

8, 8, 3, 3. 

StspWide, &spHeight); 

/* place SP at horizontal screen center position: */ 
startx= (720-spWide)/2; 

/* set offset to' start of SP.DCSQT: */ 
offset = 4 + lenTop + lenBottom; 

/* size of SP.DCSQT <= half of the size of SPU V 
while (offset < 30 ) spuBuff er { off set++ ] = 0; 



spuBufferlO) = ((offset+31)&-l) » 8; 
spuBufferfl] = ((offset+31)&-1) & OxFF; 

spuBuffer(2j = off set » 8; 
spuBuffer{3] = offset & OxFF; 

/***DCSQ#0: **V 



spuBuffer 
spuBuffer 
spuBuffer 



offset 
offset+1 
offset+2 



spuBuffer(pffs€t+3 

spuBuffer{offset+4 
spuBufferJoffset+5 
spuBuffer[offset+6 

spuBuffer(offset+7 
spuBuffer(offset+8 
spuBuffer[offset+9 

spuBuffer offset+1 0 
spuBuffer[offset+l 1 



= 0x00; . 
= 0x00; 

= (offset+24) » 8; 
= (offset+24) &OxFF; 



/* size of whole SPU */ 
/* start of SP.DSQ #0 */ 

/* STM = 0 V 

/* ptr to next SP_DCSQ */ 



= 0x03; 
= 0x32; 
= 0x10; 

= 0x04; 
= OxFF; 
= OxFF; 



/* SET.COLOR b=0 p=1 el =2 e2=3 */ 



/* SET.CONTR (0..1 5) b=15 p=l 5 e1=15 e2=1 5 V 



spuBuffer 
spuBuffer 
spuBuffer 
spuBuffer 



offset+1 2 
offset+1 3 
offset+1 4 
offset+1 5 



= 0x05; /* SET.DAREA V 
= startx»4; 

= {(startxa4) +( (slartx+spW(de-1)»8)) & 0xF3; 
= (startx+spWide-1) & OxFF; 
= starty»4; 

= ((starty«4)+((starty+spHeight-1)»8)) &0xE3; 
= (starty+spHeight-D&OxFF; 

= 0x06; /* SETDSPXA */ 
= 0x00; 
= 0x04; 

= (4+lenTop)» 8; 
= (4+lenTop) & OxFF; 



spuBuffer(offset+16 

spuBuffer(offset+1 7 
spuBuffer(offset+18 
spuBuffer(offset+19 
spuBufferloffset+20 
spuBuffer(offset+21 

spuBuffer(offset+221 = 0x01; /* STA.DSP V 

spuBuffer(offset+23J = OxFF; /♦ CMD.END V 

/*** SP.OCSQ#V. ***/ 

If(ntsc) { /* STMforNTSC: V 
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spuBuffer(offset+24l = (durationlnFrames * 3003) » 18; 
spuBuffer(ofhet+25] = ((durationlnFrames * 3003) » 10)&0xFF; 
} else { /* STM for PAL; V 

spuBuffer[offset+24| = (durationlnFrames * 225) » 14; 
spuBuffer[offsct+251 = ((durationlnFrames * 225) » 6) & OxFF; 

spuBufferIoffset+261 = spuBufferIoffset+21 ; /* ptr to Sp_DCSQ#1 */ 
spuBuffer(offset+27) = spuBuffefloffset+3) ; 

spuBufferloffset+281 = 0x02; /* STP.DSP V 

spuBuffer(offset+29) =OxFF; /* CMD.END V 

if( offsetStl ) spuBufferIoffset+301 = OxFF; /* stuffing if necessary */ 

return (off5et+31) &-1; /* length of the whole SPU */ 

) /* makeSpu( ) */ . 

* ' .' * . 

* Extern Function; makeSPPack( ) 

* . 

* Generates a complete sub-picture pack. 

* Input; pointer to an already allocated buffer for the complete 

* 2048 main data 

* Output: the encoded SP pack 

* No retum value 
* 

* Note: this simple version doesn't perform scrambled encoding 
***************♦***#*♦♦«♦***»****♦***** 

extern void makeSPPack( 

Uint8 ntsc. /* 0: 625/50; 1 : 525/60 V 

UmtS *packBuffec /* OUT: already allocated buffer for the SPU */ 
char *text, /* this text shall be encoded as SP */ 

uinG2 durationlnFrames, /* after this no. of frames 
* the SP shall disappear */ 
Uint32 starty, /* vertical start position of the SP V 

UintS *sa, /* 6 bytes SCR V 

UintS *pts. /* 5 bytes PTS^must be on top field boundary* */ 

UintS firstPacket, /* 1 : first packet of a VOB; else 0 V 
UintS spStreamNumber /* SP stream number: 0..31 */ 

Uint32 spuSize; 

Uint32 pesPrrvateDataSize=(firstPacket?3:0) ; 
/* insert pack header: V 



packBuffer 
packBuffer 
packBuffer 
packBuffer 

packBuffer 
packBuffer 
packBuffer 
packBuffer 
packBuffer 
packBuffer 



= 0x00; 
= 0x00; 
= 0x01; 
= OxBA; 



= sa 


[0] 


= scr 


1 


= scr 


2 


= scr 


3 


= scr 


4 


= sa 


5 
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padcBufferllO) =0x01; 
packBufferjl 1 =0x89; 
pack8uffer[12| =0xC3; 

packBuffer(131 =0xF8; 
n insert SPU:- */ 
spuSize = makeSpU( ntsc. 

packBuffer+1 4+1 4+1 +pesPrivateDataSi2e, 

text. 

durationlnFrames, 
starty ); 

/• insert packet header: */ 



packBuffer 
padcBuffer 
packBuffer 
padcBuffer 



= 0x00; 
= 0x00; 
= 0x01; 
= OxBD; 



packBufferflSl = (spuSize+S+l+pesPrivateDataSize) » 8; 
packBuffer! 19] = (spuSi2e+8+1+pesPrivateDataSize) & OxFF; 



packBuffer 
packBuffer 
packBuffer 

packBuffer 
packBuffer 
padcBuffer 
packBuffer 
packBuffer 



= 0x81; 

= 0x80 + (firstpadcet != 0); 
= 5+pesPrivateOataSize; 



= pts^O^ 
= ptsf- 
= pts 
= pts| 
= ptst4 



if( pesPrivateDataSize ) { 



padcBufferjZS 
packBuffer|29 
padcBuffer(30 



= 0x1E; 
= 0x60; 
= 58; 



/* private data sub stream id; */ 
padcBuffer (28+pesPrivatepataSize] 



: 0x20 + (spStreamNumber&OxlF); 



/* dear unused sector rest: */ 

while( spuSize +14+14+1+ pesPrivateDataSize < 2048 ) 

packBuffer( spuSize++ + 14 + 14 + 1 + pesPrivateDataSize 1 = 0; 
)/*makeSppadc() V 



Fig.10 
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Copyright (c) 1998. This text is the property of Thomson 
multimedia and shall not be reproduced, copied, or distributed 
without written pemnission. 



Note: values like OxAB indicates hexadecimal values (C syntax). 

THEFUNCmONCALL****** 



/* NTSC 

* text: "01:23" , 

* SP shall be active for 1 23 frames 

* vertical start position of the SP: 400, 
*sa=: {0x44,0x00. 0x45, 0x46.0x04. OxAB 

* pts = {0x21, 0x00. 0x1 1 , OxDD. 0x09 } 
*rrs the first SPU in this VOB, 

* it's SP stream #3 :*/ 
makeSPPack{ 



1, . 
mainOata, 
"01:23-, 
123. 

400, 

scr, 

pts, 

1. 

3); 



/* 0:625/50; 1:525/60 */ 
/* ptr to sector main data */ 
/* this text shall be encoded as SP V 
/* after this no. of frames 
* the SP shall disappear */ 
/* vertical start position of the SP V 
/* 6 bytes SCR*/ 

/* 5 bytes PTS, must be on a top field! •/ 
/* 1 :first packet of a VOB, else 0 */ 
/* SP stream number: 0..31 */ 



' THE RESULTING PACK: 



hex- 
addr 



content of the pack (hex values) 



0000000: 
0000010: 
0000020: 
0000030: 
0000040: 
0000050: 
0000060: 
0000070: 
0000080: 
0000090: 
OOOOOAO 
OOOOOBO: 



00 00 

01 BD 
00 6A 
20 20 
85 20 
58 58 
IC 52 
03 32 
00 26 
00 00 
00 00 
00 00 



01 BA 

00 76 

00 4C 

58 51 

00 00 

54 51 

00 24 
10 04 

01 FF 
00 00 
00 00 
00 00 



44 00 
81 81 
00 00 
05 2C 
00 00 
05 IC 



91 
FF 
01 



OD 
FF 
68 



00 00 
00 00 
00 00 



45 46 

08 21 

00 00 

51 45 

00 00 

51 45 

20 11 

05 15 

00 64 

00 00 

00 00 

00 00 
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AB 


01 


89 


C3 


F8 


00 


00 


11 


DO 


09 


IE 


60 


3A 


23 


58 


5C 


92 


45 


85 


85 


85 


20 


58 


51 


05 


24 


51 


45 


91 


45 


28 


91 


09 


24 


20 


20 


58 


51 


05 


10 


51 


45 


24 


00 


00 


00 


00 


00 


64 


70 


19 


01 


9C 


06 


00 


04 


FF 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 



.. (the remaining bytes till byte #2048 of the pack are all Zero) 
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ONLY THE SPU IN THE PACK: 



hex 

addr: content of the pack (hex values) 



0020: SPUN: 

0020: 00 6A # SPDSZ = 106 = Ox6A 

0022: 00 4C » SP_DCSQTA = 76 = 0x4C 

0024: ###################### PXD: 

0024: 00 00 00 00 20 58 5C 92 45 85 85 85 20 20 58 51 

0034: 05 2C 51 45 24 20 58 51 05 24 51. 45 85 20 00 00 

0044: 00 00 00 00 24 91 45 28 91 09 24 20 58 58 54 51 

0054: 05 K 51 45 20 20 58 51 05 10 51 45 IC 52 00 24 
0064: 91 OD 20 11 C9 24 00 00 

006c: ####################### SP.DCSQT 
006c: ####################### SP_DCSQ 0 = 0x0 

006c: 00 00 # SP_DCSQ_STM = 0 = 0x0 = 0.0000s => start frame 0 

006E: 00 64 # SP_ NXr_DCSQ_SA = 1 00 = 0x64 

0070: 03 32 10 # SET.COLOR b=0 p=l el=2 e2=3 

0073: 04 FF FF # SET.COMTR (0;:15) b=1 5 p=15 el=15 e2=1 5 

0076: 05 15 21 7D 19 01 9C # SET.OAREA sx:=338 ex=381 sy=400 ey=412 

0070: 06 00 04 00 26 # SET OSPXA uf=0x4 bf=0x26 

0082: 01 #STA'DSP 

0083: FF #CMD_END 

0084: ####################### SP_DCSQ 1 = 0x1 

0084: 01 BO # SP.DCSQ.STM = 0x1 80 = 122. 8800s 

0084: # => start frame: 123 (PAL) 

0086: 00 64 # SP_NXr_DCSQ_SA = 1 00 = 0x64 

0088: 02 #STP_DSP 

0089: FF # CMD.END 



THE RESULTING DECOMPRESSED SP: 



The following simple graphic shows the presented (decoded) bitmap. The symbol 
'/ indicates a background pixel and the symbol indicates a pattern 
pixel. The following bitmap represents a sub-picture with horizontal 44 pixel 
and vertical 13 pixel 

The (simple) graphic: 
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Fig.12 
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TV 




Fig.13a 




Fig.13b 



TV 




Fig.ISc 
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Fig.lSd 



Fig.13e 



Fig.13f 
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TV 




Fig.lSg 



TV 




Fig.13h 



TV 



Fig.13i 
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This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the appHcant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



